1/1 


W-A179  156  ADAPTIVE  BEANF08MING  WITH  THE  TRANSFORM  DOMAIN  LHS 

(LEAST  MEAN-SOUARE XU)  ILLINOIS  UNIV  AT  UBBANA  COLL  OF 
ENGINEERING  K  Z  SIEJKO  FEB  87  UILU-ENG-87-2214 
UNCLASSIFIED  N88814-84-C-8149  F/G  9/1 


NL 


February  1 98' 


UILU-ENG-8~-2214 


COORDINATED  SCIENCE  LABORATORY 

Cttllege  of  Engineering 


AD-A179  356 


r; 

!:  ADAPTIVE 
BEAMFORMING 
WITH  THE 

li  TRANSFORM  DOMAIN 
I  LMS  ALGORITHM 

f 


•>.v 


»#r 


Krzysztof  Z.  Siejko 


UNIVERSITY  OF  ILLINOIS  AT  URBANA-CHAMPAIGN 


Approved  tor  Public  Release.  Disiribunon  Unlimited. 


8  7  S 


•*,  “  % 


'.*  ’  /  *  .*  V  *.*  *>  ■ 

•  ^  >  a  a  .  v 

„*  A- l  A-l  A- .  aA  X_*  J4j\  A-  *!  *J\  aXa 


REPORT  DOCUMENTATION  PAGE 


la  REPORT  SECURITY  CLASSIFICATION 

Unclassified 


2a.  SECURITY  CLASSIFICATION  AUTHORITY 


2b  DECLASSIFICATION  /DOWNGRADING  SCHEDULE 


A  PERFORMING  ORGANIZATION  REPORT  NUMBER(S) 


lb.  RESTRICTIVE  MARKINGS 
None 


3  DISTRIBUTION  /AVAILABILITY  OF  REPORT 

Approved  for  public  release; 
distribution  unlimited 


S.  MONITORING  ORGANIZATION  REPORT  NUMBER(S) 


UILU-ENG-87-2214 


6a.  NAME  OF  PERFORMING  ORGANIZATION 
Coordinated  Science  Lab 
University  of  Illinois 


6c  ADDRESS  (City,  Start,  and  ZIP  Code) 

1101  W.  Springfield  Ave. 
Urbana,  IL  61801 


Sa.  NAME  OF  FUNDING  /  SPONSORING 
organization  Joint  Services 

Electronics  Program 


Be  AODRESS  (City,  State,  and  ZIP  Code) 
800  N.  Quincy  St. 
Arlington,  VA  22217 


1 1  TITLE  (Include  Security  Classification) 

Adaptive  Beamforming  with  the  Transform  Domain  LMS  Algorithm 


6b  OFFICE  SYMBOL  7a.  NAME  OF  MONITORING  ORGANIZATION 
(If  applicable) 

Office  of  Naval  Research 


7b.  ADDRESS  (Cty,  Start,  and  ZIP  Code) 

800  N.  Quincy  St. 
Arlington,  VA  22217 


8b.  OFFICE  SYMBOL  9.  PROCUREMENT  INSTRUMENT  IDENTIFICATION  NUMBER 
(If  applicable)  N00014-84-C-0149 


10.  SOURCE  OF  FUNDING  NUMBERS 


PROGRAM 
ELEMENT  NO 


PROJECT 

NO. 


WORK  UNIT 
ACCESSION  NO 


12  PERSONAL  AUTHOR(S) 

Sieiko,  Krzysztof  Z. 


13a  TYPE  OF  REPORT  13b  TIME  COVERED 

Technical  from _ to_ 


16  SUPPLEMENTARY  notation 


14.  OATE  OF  REPORT  (Year,  Month,  Day)  hs  PAGE  COUNT 

February  1987  I  70 


_ COSATI  COOES  18.  SUBJECT  TERMS  ( Continue  on  reverse  if  necessary  and  identify  by  block  number) 

FIELD  I  GROUP  I  SUB-GROUP  ,  _  .  ,  c  •  .  c 

i  —  I  v  trn  Koomr  a  rm  inn  a  **T*'iir  nt'/a/YOC'r*  t  nr»  t"  t*  one*  r  y  rv\ 


v adaptive  beamforming,'  array  processing,’  transform 
domain  -LMS  algorithm  .  ~i  /  .  _ 


'9  ABSTRACT  (Continue  on  reverse  if  necessary  and  identify  by  block  number) 

In  adaptive  digital  filtering,  the  Transform  Domain  LMS  algorithm  (TRLMS)  has 
shown  the  ability  of  improving  the  convergence  rate  of  the  Widrow-LMS  algorithm  at 
the  expense  of  implementing  a  fixed  orthogonal  transform.  In  broadband  beamforming, 
each  sensor  of  an  array  is  typically  followed  by  a  tapped  delay  line  to  provide 
frequency-dependent  array  weighting.  The  weights  can  be  adjusted  adaptively  to  steer 
the  nulls  of  the  beampattern  toward  any  undesired  so.urces.  For  Least  Mean-Square  (LMS) 
based  adaptive  arrays  in  a  multisignal  environment,  convergence  is  highly  data  dependent 
and  is  characterized  by  highly  disparate  modes,  resulting  in  slow  and  noisy  adaptation. 
This  work  examines  the  feasibility  of  extending  the  TRLMS  algorithm  to  the  multichannel 
scenario  of  wideband  beamforming  for  the  purpose  of  improving  convergence  rates. 


20  DISTRIBUTION /AVAILABILITY  OF  ABSTRACT  21.  ABSTRACT  SECURITY  CLASSIFICATION 

0 UNCLASSIFIED/UNLIMITED  □  SAME  AS  RPT  □  OTIC  USERS  Unclassified 


22a.  NAME  OF  RESPONSIBLE  INDIVIDUAL  |22b.  TELEPHONE  (Include  Are*  Code)  22c.  OFFICE  SYMBOL 


OO  FORM  1473, 34  MAR 


83  APR  edition  may  be  used  until  exhausted. 
All  other  editions  are  obsolete. 


SECURITY  CLASSIFICATION  OF  THIS  PAGE 

UNCLASSIFIED 


ADAPTIVE  EEAMFORMING  WITH  THE 
TRANSFORM  DOMAIN  LMS  ALGORITHM 


pv 

W  * 

KRZYSZTOF  Z.  SIEJKO 
E.S.,  University  of  Illinois,  19S6 


THESIS 

Submitted  in  partial  fulfillment  of  the  requirements 
r  the  degree  of  Master  of  Science  in  Electrical  Engineering 
in  the  Graduate  College  of  the 
University  of  Illinois  at  Urbane-Champaign,  1987 


*  ■  /*  **  A  A  ’«  A  ' 

vO"  -ft  Tj  f  ; 


ABSTRACT 
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In  adaptive  digital  filtering,  the  Transform  Domain  LMS  algorithm  (TRLMS) 
has  shown  the  ability  of  improving  the  convergence  rate  of  the  Widrow-LMS  algo¬ 
rithm  at  the  expense  of  implementing  a  fixed  orthogonal  transform.  In  broadband 
beam  forming,  each  sensor  of  an  array  is  typically  followed  by  a  tapped  delay  line 
to  provide  frequency-dependent  array  weighting.  The  weights  can  be  adjusted 
adaptively  to  steer  the  nulls  of  the  beam  pattern  toward  any  undesired  sources. 
For  Least  Mean-Square  (LMS)  based  adaptive  arrays  in  a  multisignal  environ¬ 
ment,  convergence  is  highly  data  dependent  and  is  characterized  by  highly 
disparate  modes,  resulting  in  slow  and  noisy  adaptation.  This  work,  examines  the 
feasibility  of  extending  the  TRLMS  algorithm  to  the  multichannel  scenario  of 
wideband  beamforming  for  the  purpose  of  improving  convergence  rates. 
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INTRODUCTION 

In  the  area  of  adaptive  filtering,  the  Transform  Domain  LMS  algorithm  (TRLMS) 
has  shown  the  ability  of  improving  the  convergence  rate  of  the  Wldrow-LMS 
algorithm  at  the  expense  of  implementing  a  fixed  orthogonal  transform  [1],  [2].  In 
broadband  beamforming,  each  sensor  of  an  array  is  typically  followed  by  a  tapped 
delay  line  or  digital  filter  to  provide  the  necessary  frequency  dependent  array 
weighting.  The  weights  can  be  adjusted  adaptively  to  steer  the  nulls  of  the 
beampattem  toward  any  undesired  sources.  For  Least  Mean-Square  (LMS)  based 
adaptive  arrays  in  a  multisignal  environment,  convergence  is  highly  data  dependent 
and  is  characterized  by  highly  disparate  modes.  This  results  in  very  slow  and  noisy 
adaptation. 

Much  attention  has  been  given  to  fast  adaptive  arrays.  The  well-studied  Compton 
Loop  offers  a  continuous  time  solution  [3],  [4],  and  fast  algorithms  more  robust  than 
the  LMS  are  known  to  exist  [5].  Orthcgonalization  methods  that  employ  the  adaptive 
multichannel  lattice  filter  [6],  [7]  and  eigenvector  preprocessors  [8]  have  also  been 
proposed  to  improve  the  convergence  rates. 

This  thesis  examines  the  feasibility  of  extending  the  TRLMS  algorithm  to  the 
multichannel  scenario  of  wideband  beamfcrming  for  the  purpose  of  improving 
convergence  rates.  A  special  class  of  beam  former,  the  Generalized  Sice  lobe 
Canceller,  is  scecificaliy  considered.  This  structure  converts  the  problem  of 
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linearly  constrained  adaptive  beamforming  to  one  cf  unconstrained  multiple 


reference  noise  cancelling.  Applying  the  TRLMS  algorithm  to  this  multiple  input 
case  is  nontrivial,  as  it  will  be  shown  that  many  different  arrangements  of  the  input 
data  vectors  are  possible.  In  general,  the  performance  of  a  fixed  transform 
algorithm  is  data  dependent  [1|.  The  intent  here  is  not  to  develop  means  by  which  to 
choose  a  transform,  but  to  provide  an  introduction  to  this  topic  and  to  determine  if 
the  use  of  a  fixed  transform  can  be  justified  in  this  highly  data  dependent  scenario. 

Studies  of  the  performance  of  the  Generalized  Sidelcbe  Canceller  based  on  signal 
environment  and  on  the  type  of  transform  chosen  will  be  verified  by  computer.  It 
will  be  shown  that  the  TRLMS  algorithm  can  be  effective  in  seme  situations. 
Performance  appears  to  be  dependent  upon  many  factors,  including  the  number  cf 
sensors,  the  number  cf  jammers  and  their  angles  cf  incidence,  and  the  arrangement 
cf  the  data  vectors. 
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CHAPTER  2 


BACKGROUND 


This  two-part  discussion  presents  the  necessary  background  in  linearly  con¬ 
strained  adaptive  beamforming  and  transform  domain  adaptive  FIR  filtering.  These 
seemingly  unrelated  topics  will  be  first  discussed  separately,  and  then  later  joined 
to  apply  the  ideas  of  transform  domain  LMS  adaptation  to  improve  performance  of 
the  Generalized  Sidelcbe  Canceller,  sometimes  called  the  Griffiths-Jim 
beamformer.  The  beamfcrming  application  doubles  as  an  experimental  base  in  which 
to  verify  the  extension  of  the  said  adaptive  filter  to  multiple  inputs. 

Unless  noted  otherwise,  assume  that  all  signals  are  zero  mean  and  wide-sense 
stationary,  and  that  all  wavefronts  are  planar  (generated  by  a  far  field  source). 
Assume  ail  antenna  elements  are  ideal  and  omnidirectional,  with  array  geometries 
linear  and  uniformly  spaced  at  distance  d.  Discretized  data  are  assumed  to  be 
available  at  each  element. 


2. 1  Adaptive  Beamfcrming 

The  beamforming  problem  involves  selecting  a  desired  propagating  source 
(signal)  in  an  environment  where  ether  undesirad  directional  jammers  or  noises  may 
be  present.  Adaptive  beamfcrming  involves  tracking  signal  parameters  which  are 
'.i— =  ary  mg  or  unknown.  Reference  [91  contains  a  fins  intnccuciicn  :o  this  topic. 

*.n  he  oenvemiensi  narrowband  signal  case,  each  sensor  of  :hs  linear  arrsv  .a 


«\.v 


■m 


mm 


. 


vfc-v-v- 

-  v  v 

■  < 
r  *  - 

vy.v 


'  '  ■ 

.-vi-'.-a 


:v: 


.•  .'.V  v, 

.  9+  i 

m 

'.'.Wfc'.'J 


—  v-r-  ^  f- mJ-  *  *-*  ‘-*1-  ■  A  L  -*  J&L  ^  jjl  *  *  —  *  .A. 


weighted  cy  a  complex  weight  and  summed  to  produce  the  output,  as  shewn  .n  r  .g. 
2.1a.  The  magnitude  and  phase  of  each  weight  can  be  adjusted  adaptively  to  achieve 
maximum  signal-to-interference  ratio  (SIR),  cr  calculated  directly  if  the  signal 
parameters  are  known  [9].  One  sensor  is  commonly  ised  as  a  fixed  reference  to 
prevent  the  output  from  decaying  to  zero  during  adaptation. 

A  linear  array  will  have  equivalent  response  for  angles  symmetric  about  its  axis 
(line  formed  by  the  sensors),  whereas  a  circular  arrangment  can  uniquely  respond  to 
all  360°.  To  avoid  aliasing  due  to  spatial  sampling  by  the  sensors,  the  sampling 
frequency  (array  spacing)  1/d  must  be  at  least  twice  the  spatial  frequency  of  the 
wave,  1/A.  Therefore,  d  ^  A  /2.  An  array  of  K  sensors  has  the  capability  to  reject 
up  to  K-i  jammers  and  pass  one  desired  signal.  This  is  rationalized  by  envisioning 
the  solution  cf  a  linear  system  of  K  equations  ar.d  K  unknowns. 

For  broadband  signals,  each  weight  in  Fig.  2.1a.  is  replaced  by  a  tapped  delay 
line,  as  shewn  in  Fig.  2.1b,  to  provide  the  frequency  dependent  magnitude  and  prase 
shift  ever  the  operating  bandwidth  of  the  array.  The  weights  can  be  adapted  using 
many  different  algorithms.  Also,  several  array  configurations  can  be  used  [9h  An 
important  point  is  that  adapting  the  'weights  with  a  simple  algorithm  such  as  LVS 
wcuid  result  in  their  decaying  to  zero.  This  corresponds  to  a  minimization  cf  the 
cutout,  which  happens  to  be  zero  in  this  case.  As  mentioned,  an  unweighted 
reference  sensor  can  be  used  to  prevent  this,  causing  a  useful  output  to  be  present 
ever,  if  the  weigrts  became  zero.  However,  the  desired  signal  may  -till  be  cancelled 
If  Its  ral.at.ve  power  level  :s  -ugh,  similar  to  beha.ior  srccurterad  .n.  abac ’..a  -s.se 
cancelling  uren  oss  rad  sizra.  ocmccrerts  are  erasers  in  the  reference  shame,  'r  . 
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One  solution  proposed  by  Frost  [10]  places  a  linear  constraint  on  the  weights  to 
prevent  their  decay  to  zero.  This  constraint  is  also  used  to  process  the  desired 
signal,  fixing  its  response  regardless  of  signal-to-interferencs  ratio  (SIR).  Another 
similar  linearly  constrained  adaptive  broadband  array  will  be  the  focus  of  attention, 
namely  the  Generalized  Sidelobe  Canceller. 


2.1.1  The  Generalized  Sidelobe  Canceller 

Figure  2.2  shows  the  Generalized  Sidelobe  Canceller  Broadband  Eeamformer 
(GSC),  first  analyzed  by  Griffiths  and  Jim  [11].  This  structure  has  been  of  recent 
interest  to  researchers  due  to  its  flexibility  and  simplicity  [9],  [12].  It  is 
appealing  in  the  sense  that  any  unconstrained  adaptive  algorithm  or  filter  structure 
WjJn)  may  be  used  for  its  implementation.  For  example.  Reference  [12]  reports 
improved  SIR  for  the  GSC  using  pole-zero  filters  in  place  of  conventional  tapped 


delay  liras,  although  only  the  FIR  case  will  be  considered  here.  The  cniy  constraint 
on  the  GSC  is  that  the  location  of  the  desired  signal  must  be  known  a  priori. 

The  GSC  has  a  direct  analogy  to  adaptive  r.cise  cancelling  with  multiple  reference 
inputs,  making  it  easy  to  analyze  and  understand.  Refer  to  Fig.  2.2.  The  desired 
broadband  signal  S„.(h)  impinges  upon  the  array  from  the  lock-direction,  defined  as 
the  angle  9=0°  with  respect  to  the  array  normal.  Appropriate  steering  delays  at 
each  sensor  may  be  used  for  alignment  if  necessary.  Since  S  .(n)  is  ir.  chase  at  each 
sensor,  it  Is  blocked  from  the  filter  incuts  X  (r.)  by  the  subtractive  preprocessing 

to  the  'primary  input"  channel  d[rj.  Thus.  S -v’n.)  r asses  to  the 
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in  the  d(r.)  channel.  Any  other  broadband  signals  S.  (n)  (assumed  to  be  uncorrelated 
with  S^(n))  arriving  at  angles  off  the  lock-direction  will  have  components  in  both 
d(n)  and  the  "reference  input"  channels  X^(n),  1^  k  ^K- 1 .  These  components,  although 
correlated,  differ  due  to  effects  of  the  preprocessor  and  the  spatial  sampling  process 
of  the  array.  For  example,  the  contribution  of  S^n)  to  d(n)  is 


N°(n)  =  ^-2Si[nT-(k-l)A1+*i] 
k  1 


(2.1) 


with  arbitrary  phase  <p.  and  intersensor  propagation  delay 

A  _  2nd  sin0  , 

A-arr 


(2.2) 


determined  by  angle  0,  sensor  spacing  d,  radian  frequency  cj  and  its  corresponding 
wavelength  A  (for  a  ncrdispersive  madia,  constant),  and  sampling  period  T. 

The  contribution  of  S.  (n)  to  the  reference  input  is 


N.  (n)  =  S.[nT-  (k-i  )£.-*-<£.]  -  S,[nT-icl.T<£.] 

i»  1  1X1  1  i 


(2.2) 


.re  array  output  e(r.)=d(n)-y(n)  ser/es  as  the  error  signal  to  ce  minimized  by  the 

inactive  filters  of  impulse  response  W,  (n).  Let  X  (r.)  be  a  vector  of  length  corres- 

tending  to  W,  (n).  Then, 

!% 


i(n)  =  d(n)  -  2  (X  fr.r  W,/r.)] 

r _ 4  \  X 


(2.4) 


P  0 


N°(n)  =2N,W 
i=i  1 


(2.5a) 


N.  (n)  =  2N,  (n) 
K  1=1  lk 


(2.5b) 


The  classic  adaptive  noise  cancelling  scenario  [13]  is  now  clear;  the  primary 

o 

input  signal  d(n)  consists  of  a  desired  signal  S^(n)  plus  a  noise  component  N  ,  and 

th  1  0 

the  k  reference  input  consists  of  noise  N  which  is  correlated  to  N  but  not  to 

S^(n).  The  weights  of  the  W^’s  are  adaptively  adjusted  to  cancel  (2.5a)  with  the 

multiple  references  of  (2.5b),  minimizing  e(n)  in  the  mean-square  sense  while 

leaving  S^(n)  intact. 

The  GSC  can  be  categorized  [9]  as  a  "hard  constraint"  structure,  so  called 
because  it  maintains  a  fixed  Icck-directicn  response  regardless  of  signal  strengths. 
Other  predecessor  structures  with  "soft  constraints"  make  use  of  training  signals  or 
require  a  minimum  SIR  to  maintain  a  specified  lock-direction  sensitivity.  Other 
classifications  are  "linearly  constrained  minimum  variance  beamfermer"  or 
"maximum  likelihood  array,"  which  again  imply  that  the  output  power  of  the  array 
can  be  minimized  without  fear  of  cancelling  any  useful  output  (assuming  unccrraiatad 
inputs).  A  point  worth  noting  is  that  as  the  desired  signal  deviates  from  the  icck- 
directicn,  its  wavefront  components  become  cut  of  phase  at  each  sensor.  This  signal 
then  "leaks"  into  the  reference  channels,  since  the  preprocessor  can  no  longer 
completely  block  it.  I;  the  relative  power  cf  this  signal  is  high,  the  weights  would 
adspi  :o  cancel  S„(r.)  from  the  output,  due  *.c  correlated  compcrerts  in  ‘.he  onmary 
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applications  [9]. 

Gccch  and  Shynk  [12]  have  shown  that  the  optimal  solution  for  W^(n)  contains 
both  poles  and  zeros.  This  solution  will  perfectly  cancel  any  coherent  interference. 
The  transfer  function,  however,  contains  unrealizable  fractional  powers  of  Z  (Z- 
Transfcrm  variable)  in  the  denominator  which  correspond  to  A  in  (2.2).  This 
implies  that  an  effective  FIR  sciuticn  will  most  likely  require  a  very  large  filter 
order  to  approximate  the  impulse  response  of  the  IIR  solution. 


2.1.2  Wiener  Solution  for  the  GSC 

Refer  to  Fig.  2.3.  Note  that  the  sensors  and  preprocessor  stage  have  been 
removed  for  simplicity.  For  a  K  sensor  array  there  are  K-i  reference  inputs.  Let 
L  be  the  length  of  the  FIR  filter  at  each  rsfersncsy  represented  by  the  weight  vector 
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and  its  corresponding  data  vector 


(2.5a) 


c  .y. 

i  r 


(n)  —  [  x^  (n)  xf<  ^  (n) 


xk(L-l)[n)  ^ 


(2.5b) 


Since  the  filter  bank  output  y(n)  consists  of  the  summation  of  all  (K-l)L  weighted 


outputs,  'we  can  arrange  the  (K-l)L  dimensional  weight  and  data  vectors  and  X„ 


For  this 


is  arbitrary,  an  important  point  to  be  considered  further  in  Chapter  4. 
analysis,  W"n  and  Xn  can  be  arranged  by  "stacking"  the  sub  vectors  cf  (2.5)  as 


'  Wj(n) 

Xt(n) 

W2(n) 

M 

IX 

1 

X2(n) 

n 

WK-1« 

XK-l(n) 

w  * 

The  remainder  of  the  analysis  is  identical  to  that  for  the  standard  discrete 

Wiener  solution  [9].  The  quantity  to  be  LMS  minimized  is  e(n)=d(r.)-y(n).  Taking 
2 

E[e(n)  ]  yields 

EtsW1]  =  Eid(n)!]  +  E[W]tXnX;Wn! 

=  E[d(n)2  ]  -  2Wn‘  Px  +  Wnl RxWn  (2.9) 

from  which  the  autocorrelation  matrix  R  =  E[  X  X  ^  and  the  cross-correlation 

x  1  n  n J 

vector  P^=  E[  d(n)X  ]  are  defined.  The  optimal  Wiener  solution  is  achieved  by 
x  n  - 

taking  partials  of  (2.9)  with  respect  to  wT ,  as 

8E[e(n)2]  k  =  1,2 . K-l 

-  =  0  1  =  C,  1, _ L-i  (2.1C) 

3wkl 

to  vieid  the  familiar 


Mary  algorithms  such  as  Wiorow’s  _\;S  or  the  \_5 


l-*) 


axis:  o  oo..=  2.1. 
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iteratively,  and  the  flexibility  of  the  GSC  allows  any  suitable  choice.  One  choice 
which  shows  promise  cf  improved  convergence  rate  over  the  LMS  algorithm  is  the 
Transform  Domain  LMS  algorithm.  The  next  section  examines  this  algorithm  for  the 
general  case. 


2.2  Transform  Domain  Adaptive  Digital  Filters 

It  is  known  that  the  convergence  rate  cf  an  LMS  adaptive  Filter  is  governed  by 
the  eigenvalues  of  the  input  covariance  matrix,  which  in  turn  are  related  to  the 
power  spectrum  of  the  input  [2].  The  idea  behind  transform  domain  adaptive 
filtering  is  simply  to  whiten  the  input  power  spectrum.  This  equalizes  the  eigen¬ 
values,  allowing  the  ''modes"  cf  the  system  to  converge  at  the  same  rata.  The  beauty 
cf  the  TRLMS  filter  lies  in  the  fact  that  no  inverse  transform  is  necessary;  the 
transform  acts  only  as  an  orthogonal  mapping  cf  the  weight  vector  and  the  data 
vector  into  a  domain  where  the  desired  cower  normalization  is  feasible. 

The  Wicrcw  LMS  algorithm  is  given  by 


W 


n+1  ”  Wn  +  2^9nXn  * 


n  12' 


An  expression  for  the  convergence  of  the  mean  weight -error  vector  is 


E[Vn]  =  [!-2^Rx!"Va. 


n  • 


where  V  - 


=W  -  W  R  is  the  autocorrelation  matrix 
n  ‘  cot  x 


[assumec  to  be  staiicnarv) , 

/  '  7 


where  Q  is  a  matrix  whose  columns  are  the  orthcncrmal  eigenvectors  or  Rx,  and  A  is 
the  diagonal  matrix  of  their  corresponding  eigenvalues,  /V.  For  simplicity,  assume 
that  a  distinct  eigenvector  exists  for  each  eigenvalue.  Combining  (2.13)  and  (2.14) 


vieids 


E[VJ  =  [l-2pA]nVo 


(2.15) 


which  clearly  can  be  separated  into  N  medal  equations.  The  time  constant  for  the 
i  mode,  calculated  from  the  geometric  .ratio  1-2/iA^,  is  shown  to  be  [9] 


r.=  1  /4pi 


(2.16) 


Clearly,  overall  convergence  is  governed  by  the  mode  corresponding  to  the  smallest 
eigenvalue,  ^min-  A  highly  disparate  eigenvalue  spread  will  result  in  poor  perfor¬ 
mance.  Since  the  eigenvalues  of  R^  are  bounded  by  tne  minimum  and  maximum  'val¬ 
ues  of  the  input  power  spectrum  [15],  whitening  of  the  input  results  in  all  eigenval¬ 
ues  being  identical.  For  fixed  levels  of  steady-state  MSE,  X  ■  then  becomes  max- 
imurn  and  convergence  is  improved  [2],  An  erthegenai  transform  permits  seme  di¬ 
rect  manipulation  of  the  eigenvalues,  the  degree  of  which  depends  cn  the  transform. 
Tne  7RLMS  filter  is  shewn  in  Fig.  2.4.  For  each  time  index  n,  the  data  vector 
is  ‘ransfcrrr.ee  by  an  orthogonal  N  xN  matrix  T.  defining  yfn),  cu  ,  and  tc  be 


/>n;  =  S_’ ju_„  -  u; 
S_  -  TX_ 


N  X  N  ORTHOGONAL  TRANSFORM 


the  optimum  Wiener  solution  can  be  shown  to  be 


.i 

=  R  P 
s  s 


(2.19a) 


where 


R  =  E[S*  S_*  ]  and  P=E[d(n)SJ.  (2.19b) 

s  n  n  s  n 


The  relationship  between  time  and  transform  domain  solutions  can  be  established. 
From  (2.13)  and  (2.19)  we  have 


R=TRT  and 


P  =TP 
s  x 


(2.20) 


and  substituting  into  (2.19a)  yields 


uc-t  =  cnyW px  =  dr  r;  p, 


<2  21) 
v**«  *  y 


Thus  the  transform  maps  the  weight  vector  as  '-veil,  and  (2.21)  can  be  used  to  re¬ 
cover  the  time  domain  solution  if  neseccary. 

As  discussed  in  [2],  the  minimum  mean-square  errors  of  the  time  domain  and 
the  transform  domain  filters  will  be  identical  as  long  as  T  is  orthogonal  or, 


TTW  =  *I  , 


f2  22' 

l  A*  • 


'••“era  x  is  a  scaling  factor  dependent  upon  N  and  type  of  transform. 


1 


The  Transform  Domain  LV1S  algorithm  [2]  is  given  by 


cj  .  ,  —  Cl)  +nS  e 
— n+i  — n  1  n  n 


12.22) 


where  rj  is  a  constant  convergence  factor.  Similar  to  (2.13),  the  mean  weight-error 


vector  is 


E[vn]  =  [I-2„Rs]n;o 


(2.24) 


where  yn  =  It* is  known  that  unitary  transforms  preserve  the  variance, 

and  in  turn,  the  eigenvalues  of  an  autocorrelation  matrix.  Therefore,  with  ap- 
rcpriate  selection  of  rj,  (2.24)  and  (2.13)  will  have  the  same  time  constants.  By 
setting  n  =  \i/k,  'where  x  is  N,  N/2,  and  N  for  the  DFT,  DCT,  and  DHT  respectively, 
identical  performance  of  the  LMS  and  the  TRLV1S  filters  is  expected  [2]. 


2.2.1  Orthogonal  Transforms 

Many  discrete  crthcgcnal  transforms  axist.  The  three  'which  will  fce  considered 
here  are  the  Discrete  Fourier  Transform  (DFT),  the  Discrete  Hacamard  Transform 
(DHT),  and  the  Discrete  Cosine  Transform  (DCT).  The  optimal  Karhur.e.n-Loeve 
Transform  (XLT)  will  perfectly  decorreiata  an  input  and  diagonalize  its  auto¬ 
correlation  matrix.  Tine  KLT  is  based  on  input  statistics  and  generally  net  used  in 


an  adaptive  environment  where  signal  parameters  are  time  varying. 


CcHwiCSi  1C 


'2.14),  it  involves  solving  for  the  eigenvectors  of  R^  and  nc  general  fast  algorithm 
ax.sts.  The  XL”  ear, as  merely  as  a  reference  for  the  succptimal  uses. 

The  I  FT  is  ,oea:  for  none  .ax  valued  incuts  arc  fast  VLZI  imc.emsriaticrs  axist. 
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but  for  real  inputs  the  complex  arithmetic  is  cumbersome.  The  basis  functions  for  a 


matrix  representation  are  the  familiar  complex  exponentials, 

t  .  =e"j2irJm/N,  0  £  J,m  £  N-l.  (2.25) 


The  CCT,  a  similar  counterpart  of  the  DFT,  uses  only  real  coefficients,  and  fast 
algorithms  exist  for  a  limited  number  of  values  for  N  [16].  Its  kernel  is  of  the 
fcrm 


t  J^  =  a(l)cos{^^-1-i},  ,  0*J,mSN-i, 


■2(0)  =  ^  ,  or(J)  =1  i  r  Q- 


(2.25) 


A  2N  FFT  can  be  used  for  computation  of  (2.26)  due  to  the  similarity  'tween 
them.  The  CCT  has  shewn  performance  closer  to  the  optimal  Karhunen-Lceve 
Transform  (KLT)  than  ether  transforms  for  many  applications,  including  image 
coding  and  channel  equalization,  and  is  asymptotically  equivalent  to  the  KLT  for 
Markov- i  signals  as  N  -p  as  [15]. 

The  DHT  has  been  cf  great  interest  due  to  its  computational  simplicity. 
Ccmpcsed  cf  Waish  basis  hxetiens  which  take  cn  values  of  + 1  and  - 1 ,  the  CHT  can 


be  computed  with  simple  additions  and  suiirscticns.  For  axampie,  the  CHT  matrix 


.1  * 

and  it  has  the  special  property  that  T  =  T  =  T\ 

The  identity  matrix  can  aisc  be  considered  as  an  orthogonal  transform.  Since 
the  i  matrix  simply  passes  inputs  to  the  weights  unaltered,  use  of  this  transform  in 
the  TRLMS  algorithm  is  equivalent  to  the  LMS  algorithm.  This  fact  will  simplify 
comparisons  of  the  TRLMS  algorithm  to  the  LMS  case. 


*H3 


2.2.2  Seif- Orthcgcnallzing  TRLMS  Adaptive  Filter 

Ccnsider  now  the  seif- orthcgcna  1  izlng  TRLMS  algorithm  [2],  where 


■HG-m- 


o  =  o  t  liR  Se 
— n+i  — n  r  s  n  r 


(2.23) 


•v.v.v 


£i;ni  =  (i-2Jis’R/;(. 


(2.2S) 


V.V; 


R_  is  a  diagonal  matrix  whose  elements  are  the  power  estimates  of  each  s.,  namely, 


2  2 


Rs  =  diag[  c0  £,•••£. 


•  <7.-1  J. 


(2. 2C) 


It  is  known  that  the  transforms  under  consideration  will  approximataiy  diagonalize 
the  R  matrix.  For  the  optimal  KLT  case  the  diagonal  elements  of  R  will  be 
ecuivaier.t  to  the  incut  variances  [17],  and  R_  R  -  I.  Eq.  (2.29)  vcuid  than  be 
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cases,  the  residual  orf-diagonal  elements  of  causa  cross  coupling  of  the  modal 
aquations,  resulting  in  some  disparity  among  the  time  constants.  The  effectiveness 
of  a  specific  transform  is  strongly  dependent  upon  the  class  cf  inputs.  This  is 
illustrated  experimentally  in  [1]. 

An  effective  method  of  estimating  the  power  c\2(n)  is  via  a  single  pole  low-pass 
filter  as  given  in  [2] : 


5'i2(n)  =  0  d^Cnrl)  +  (1-0)  s^n)  s^n)  , 


(2.32) 


where  0  is  the  smoothing  constant  which  controls  estimation  accuracy  and  tracking 
ability.  Reference  [2]  provides  a  detailed  discussion  on  the  effects  of  choices  of  0 
and  initial  power  estimate  o\2(0)  on  the  convergence  rate. 

Thus,  the  self- orthogcnalizing  TRLMS  algorithm  is  identical  to  (2.23)  with  a 
time  varying  convergence  factor,  namely  rp/i/c.2(n)  .  The  algorithm  to  be  examined 
ir.  this  thesis  is 


u,(n+l)  =  u«(n)  +  — =r —  e(n)  s.(n) 

1  s,  w 


(2.23) 


This  is  simply  the  decoupled  version  of  (2. 23).  To  insure  equivalent  disadjustment 
levels  for  the  purpose  cf  comparing  transforms,  the  Identity  transform  will  be  used 
in  this  algorithm  in  place  cf  the  LMS  algorithm.  Power  normalization  also 
eliminatas  the  concern  for  the  proper  choice  and  computation  of  the  normalizing 
factor  in  (2.22). 

An  srs*c *  -  hsicful  to  the  urderstardirz  r:  the  os-f-orthce-ralizirs  “LMS  filter 


\  tv's  '.‘’f-’y 


■vii  Wv  j m 


is  to  envision  the  sliding  transform  of  Fig  2.4  as  a  bank  of  bandpass  filters  [18] 
For  the  DPT,  the  transform  kernel  (2.25)  can  be  likened  to  an  FIR  filter  hj(n)  of 
length  N  with  input  Xn  and  output  Sj(n).  For  J  =  0,  h<>(n)  has  a  rectangular  impulse 
response,  giving  a  frequncy  response  of 


H  ,Jw,  _  sin fcjN/21 
0  sin(cj/2) 


(2.34) 


which  is  a  sine-type  function  centered  at  cj  =  0.  At  the  i  frequency  bin 
corresponding  to  the  output  Sj(n)  and  center  frequency  2tJ/N,  the  frequency  response 
is  simply  a  shifted  version  of  H0(e^w),  equal  to  H0(e^  ^^xf/N)^  All  of  these 
filters  will  have  seme  degree  of  overlap  which  can  be  lessened  by  increasing  N  or  by 
windowing  [18].  The  power  spectrum  is  whitened  by  appropriately  scaling  each  of 
the  frequency  bins.  For  real  transforms  (CCT,  CHT),  the  filter  responses  are 
generally  net  symmetric  and  may  not  have  the  same  bandwidth  for  all  frequency 
bins.  By  comparison,  the  KLT  produces  a  spike  at  each  frequency  bin,  implying  re 
overlap  and  perfect  decorrelation. 

Thus,  the  convergence  rate  of  the  Widrcw  LV!S  algorithm  can  be  improved  at  the 
expense  of  implementing  an  orihcgcral  transform  and  estimating  the  pewer  at  each 
of  the  frequency  bins.  Although  other  well  understood  algorithms  such  as  R!_5  or 
the  adaptive  lattice  may  be  more  efficient  [9],  the  point  here  is  to  explore  the 
extension  of  the  TF.L.MS  algorithm  to  mult. a. a  refaranca  inputs  for  scciicaticr,  to  the 
problem  of  wicebsno  adaptive  arm av  procsssirg.  This  will  be  discussed  in  subsecua-: 
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CHAPTER  2 


APPLICATION  OF  THE  TRANSFORM  DOMAIN 
LMS  ALGORITHM  TO  THE  TWO  SENSOR  GSC 


This  chapter  examines  the  combination  of  the  topics  discussed  in  the  previous 
chapter,  cf  the  application  of  the  TRLMS  algorithm  to  the  two  sensor  GSC 
fceamformer  for  the  purpose  of  improving  its  rate  of  convergence  to  the  optimal 
Wiener  solution.  The  analysis  for  this  most  simple  case  has  essentially  already 
beer,  presented  in  Section  2.2,  the  only  difference  being  the  nature  of  the  desired  and 
reference  inputs  cf  Fig.  2.4.  The  main  intent  here  is  to  provide  a  feel  for  the 
operation  cf  the  Transform  Domain  GSC  via  computer  experiments. 


1  Two  Sensor  Scenario 


m 


he  two  element  (K=2)  GSC  shown  in  Fig.  2.1  was  simulated  on  a  Zenith  153 


PC  ising  FORTRAN.  Sensors  were  spaced  at  a  distance  d=\Q/2,  where 


/^corresponds  to  the  wavelength  at  the  array’s  center  frequency.  A  broadband  signal 
and  jammer  were  generated  by  coloring  uniformly  distributed  zero  mean  pseucc- 
wnite  noise  with  a  fourth  order  Euttarwcrth  bandpass  filter.  As  in  Fig.  2.2,  its 
normalized  center  frequency  is  =  it/ 2  with  2cb  bandwidth  =  tt/2.  To  prevent 
frequency  aliasing,  the  tap  spacing  of  the  filter  W  corresponds  to  half  a  wavelength 
*t  t~a  maximum  array  frscuercv.  A.l  m.entionec  oarsmetsrs  were  normalized  to  tha 


g.  3.1 


Two  sensor  GSC  to  be  simulated 


10  simulate  a  propagating  wavefront  incident  upon  the  array  at  angle  9,  from 
(2.2)  the  intersenscr  delay 

A  =  2sin6  (3.1) 

was  implemented  using  a  sine  interpolator  weighted  by  a  Hamming  window  [12], 
[21].  For  this  class  of  signals,  the  interpolator  length  which  gave  a  reasonably  low 
mean-square  error  was  experimentally  calculated  to  be  11  taps. 


3.2  Experimental  Results 

The  self-crtbcgcnalizirg  TRLMS  algorithm  of  (2.33)  was  implemented  with  an 
Identity  transform  of  length  L=S.  A  jamming  signal  incident  at  20°  was  set  to  be 
20  db  above  the  lock-direction  signal.  The  step  size  constant  'was  chosen  as  /j  =.005 
with  power  normalization  factor  £  =.S  and  initial  power  estimates  c^C)  =  .10  .  Ail 
weights  'were  initialized  to  zero.  The  plotted  output  SIR  cur/e  for  15K  iterations  is 
shown  in  Fig.  3.3  .  The  mean-square  error  for  this  "learning  cur/e"  is  calculated 
using  a  sliding  window  of  150  points. 

Next  examine  the  SIR  cur/e  for  the  same  data  sequences  and  parameters  using 
the  CFT,  also  shewn  in  Fig.  3.3.  As  expected,  the  convergence  rate  is  improved 
substantially.  Even  though  the  complex  number  domain  of  the  DPT  results  in  a 
complex  cutout,  as  the  weights  converge  the  imaginary  part  becomes  negligible  [9], 
end  cruy  the  real  par.  is  used  in  SIR  calculations. 
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Fig-  2.3  Improvement  of  convergence  using  the  DFT  fcr  this  two  sensor  esse 
(9=20°,  p=. CCS,  L=S,  0=.S) 


SIX  ! 

in  j 

99  9,r 


^xum.in 


wry'w  , 


JtVi 

fT  x 


1 

-11 - 

9  :m, 


^IMH. 


>399, 

iterations 


ret  reflected  by  an  improvement  in  its  performance,  as  the  3imple  CHT  works  just 


as  well  in  this  case.  Also,  Fig.  2.4  indicates  that  all  cases  are  converging  to  the 
same  solution  in  terms  of  SIR, 


3.3  Converged  Eeampattems 

Figure  3.S  shows  the  converged  beampattem  for  the  final  weight  values  in  terms 
of  array  gain  (the  ratio  of  power  out  to  power  in  )  in  Db.  Since  the  array  gain  is 
frequency  dependent,  the  plot  was  generated  by  averaging  beampattems  for  discrete 
frequencies  over  the  signal  bandwidth  [12].  The  gain  in  the  look-direction  is  0  db  as 
expected.  The  frequency  response  of  the  array  at  20°  is  plotted  in  Fig.  3.5,  dem¬ 
onstrating  the  attempt  to  reject  the  signal  over  its  bandwidth.  The  gain  for  0  =0°, 
if  plotted,  -would  show  a  flat  response  over  the  entire  operating  bandwidth.  The 
symmetry  in  Fig  3.5  is  due  to  the  linear  array  geometry. 


Notice  that  the  initial  output  SIR  in  Figs.  3. 3-3. 4  dees  net  coincide  with  the 
assigned  value  of  -20  cb.  This  is  explained  by  the  fact  that  the  summation  cf  the 
sensors  to  form  the  primary  channel  acts  as  a  conventional  beamfcrrr.er,  with  each 
sensor  weighted  by  unity.  Therefore,  seme  attenuation  exists,  prcpcrticnai  to  the 
deviation  from  0=0".  For  broadband  signals,  this  effect  depends  on  the  the  spectrum 
of  tu.e  s:gna:.  Figure  3.7  shows  the  initial  beampattem,  all  -weights  set  to  zero, 
averaged  over  the  signal  bandwidth  of  t/0.  As  an  example,  the  same  jammer  was 
placed  at  S =55"  to  coincide  with  the  droop  of  the  response  of  Fig  2.7,  yieictng  the 
oIR  curve  of  2.2.  The  5IR  has  a  head  star.  ::  5  db.  but  still  convenes 


the  array  has  a  fairly  triform  rejection  capability. 

In  general,  for  this  simple  two  sensor  case,  the  C-SC  appears  to  be  very  well 
behaved.  However,  for  the  three  sensor  case  with  two  incident  jammers,  it  will  be 
revealed  in  the  next  chaoter  that  this  is  not  always  the  case. 


CHAPTER  4 


APPLICATION  OF  TRLMS  TO  ■ 
THE  THREE  SENSOR  GSC 


The  three  sensor  GSC  shown  in  Fig.  4.1  has  the  capability  to  reject  two 
jamming  signals  and  pass  one  desired  broadside  signal.  Convergence  behavior  for  the 
one  jammer  case  is  very  similar  to  the  results  presented  in  Chapter  3,  with 
improved  cancellation  ability  due  to  the  additional  degree  of  freedom  which 
accompanies  the  extra  sensor  [19]  -  However,  when  a  second  jammer  is  present,  the 
LMS  algorithm  can  be  '/ery  slow  and  impractical.  Convergence  behavior  of  the  LMS 
algorithm  for  fceamfcrmers  in  general  is  characterized  by  highly  disparate  modes 
[3],  [4]  containing  both  very  slow  and  fast  components.  To  remedy  this  situation, 
orthogonal  transforms  car.  be  used.  However,  for  this  multi-reference  case,  they  can 
enter  into  the  picture  in  several  different  ways,  with  efficiency  dependent  upon  the 
type  of  transform  chosen,  the  input  data,  and  the  ordering  cf  the  data  vector  X^. 


4. 1  Convergence  cf  the  GSC  for  the  LVIS  Algorithm 

Eased  on  experimental  observations,  the  dependence  cf  angle  and  rate 
convergence  will  be  established.  Although  these  results  are  rot  intended  to 


cf 


conclusive,  they  serve  to  illustrate  the  motivation  for  the  use  of  transforms. 
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Fig.  4.2  Initial  array  gain  fcr  the  three  senscr  GSC. 


rescactive  levels  cf  f  .  .  It  is  true  that  f  .  is  angle' dependent,  since 

^rmn  'min  *  r  * 

fTT,in  =  ™in{E[eCn)*]}  =  Eldlc)2]  -  pV  Px 


(4.3) 


contains  the  angle  dependent  quantities  P^,  R^,  and  E[c[n)2].  However,  it  will  be 

shewn  in  later  sections  that  substantial  improvement  in  convergence  rates  can  be 

made,  and  variations  in  ?.  are  not  as  drastic  as  one  could  be  led  to  believe. 

min 

Also,  by  carefui  inspection  of  Fig  4.2,  from  the  very  gentle  upward  slopes,  one  can 

4 

observe  that  the  cur/es  are  still  very  slowly  converging,  even  after  10  iterations. 

For  the  sake  of  completeness,  the  above  notion  was  verified  by  computer.  A  sin¬ 
gle  broadband  jammer  was  scanned  across  the  array  by  ere  degree  increments  from 
1"  to  9C  .  .-‘.gam  a  signal  2C  db  below  the  jammer  was  fixed  at  3  =  C  .  Ire  weights 
were  allowed  to  converse  suffioiently  fcr  each  arris,  with  results  clotted  .n  Fir. 


4.4.  No 
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sensor*  GSC  may  be  found  in  [12],  Acart  from  final  SIR  'values,  similar  resells 


should  be  expected  for  the  two  jammer  case  due  to  linearity.  This  was  not 
attempted  due  to  the  high  computational  expense  of  simulating  two  jammers. 

This  rather  speculative  discussion  has  presented  some  evidence  suggesting  that 
performance  cf  the  LMS  algorithm  can  be  very  peer  for  disparate  angles  of  arrival, 
Time  constants  cf  adaptation  and  initial  SIR  'values  may  widely  differ,  but  variations 
in  £  ,n  may  not  be  as  drastic  as  expected. 
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Fig.  4.4  Maximum  SIR  -vs.  angle  for  one  jammer  at  -2C  d2,  ^=15,  <=2 


4.2  TRLMS  Applied  to  Individual  Filters 

A  logical  progression  from  Chapter  2  -veuid  be  to  apply  a  transform  to  X,  ard 
X2  individually.  Although  this  arrangement  may  provide  some  tmerevemert,  .i  dees 
not  utilize  the  inherent  correlation  between.  X,  sr.d  X:.  The  oross-ocrreiatior.  ex. sis 
aims  both  vectors  ocr.tain  time  de.ayed  oomocrer.ts  the  Impinging  s.g-a.a.  4 
oeri  .et.on  of  oower  scaotrum  arc  the  oross-cc  ver  szecimm  of  the  refererca  .~suis 
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io  examine  the  mccal  equations  for  the  purpose  of  verifying  that  applying 

transforms  in  an  individual  fashion  is  subcptimal,  the  Wiener  solution  must  be 

rederived  for  the  individual  case  so  the  structure  of  the  R  matrix  can  be  revealed. 

s 

Defining  the  error  to  be 


e(n)  =  d(n)  -  XttWl  -  x\  W2 


(4.4) 


and  taking  E  [e(n)2]  yields 


E[e(n)*]  =  E[d(n)Jl  -  2Pfw,  -  2Pjw,  +  wf  R^.W,  +  W^R^W,  + 


(4.5) 


where  P,  =  E[d(n)XJ,  P2  =  EJdfnlXJ,  R^,,  =  E[X,x}],  =  E[X2X2l],  and 

Rx:2  =  R’ ;i  =  E[X.xi ].  The  time  Index  n  has  been  dropped  cn  the  vectors  and 
matrices  for  simplicity.  The  Wiener  solution  can  be  obtained  by  applying  (2.10)  to 
(4.5)  directly,  but  the  object  her a  is  to  minimize  (4.5)  with  respect  to  the  indivi¬ 
dual  vectors  Wt  and  W2  to  produce  two  separate  equations,  namely 


=  -2P1r2W,'Rxll  +  2'V2;Rx:i  =  0  , 

=  -2P2  -  2'Vj  Rx,s  +  2W*r  Rx,2  =  0  , 

(0  £  J  *  L-l)  . 

Equation  (4.2)  can  be  arranged  in  block  matrix  form  to  produce 


(4.5a) 


(4.5b) 
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The  arrangment  cf  the  weight  vector  is  identical  to  the  stacked  ordering  of  (2=8). 
Therefore,  the  solutions  derived  in  Section  2.1.2  and  (4.7)  are  identical.  Equation 
(4.7)  helps  to  clarify  the  underlying  block  matrix  structure  of  the  system 
autocorrelation  matrix  R^.  It  contains  Toeplitz  autocorrelation  matrices  along  the 
diagonal,  and  cross-correlation  matrices  elsewhere. 

Now  the  affects  of  an  orthogonal  transform  can  be  studied.  Using  the  definitions 
of  (2.20)  and  the  linear  properties  cf  the  transform,  it  can  be  shown  by  substituting 
(2.20)  directly  into  (4.7)  that 
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or  in  compact  notation,  ^cDt  =  Rs  Ps.  Thus,  the  system  Rg  matrix  for  individually 

applied  transforms  can  be  obtained  by  transforming  each  cf  the  LxL  submatrices  cf 

R„  as  specified  in  (4.7). 

✓> 

Clearly,  the  Rx  matrix  can  never  be  completely  diagonalized  when  transforms  are 
applied  individually.  For  the  optimal  KLT,  R  takes  on  the  form 
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The  eigenvalues  X  ^  along  the  main  diagonal  of  (4.9)  are  equivalent  to  the  power 

*u 

cr2^  at  the  output  of  w^  [17].  From  (2.29),  the  i  medal  equation  of  subvector 


cecomes 


E[vH(n)]  =  [  1  -  2;ix“/9»1]n</11(0)  +  [-2fiX|VaJ1]'Vi+1_C0) 


12  11 


=  !  1  -  2/ilny,l(0)  +  [-2>jA1/X1]ny1+LiO)  . 


(4.10) 


Thus  Eq.  (4.10)  is  clearly  not  decoupled  due  to  the  rightmost  term.  For  suboptimal 
transforms  the  cross  ^coupling  may  involve  additional  terms. 

The  performance  of  transforms  in  this  situation  is  highly  dependent  upon  the 


12  11 


data.  For  example  if  the  matrix  R  n  -  R  :2  =  R  22>  then  (X  ./X  .)  -  1  and  the 
time  constants  of  (4.10)  would  be  approximately  uniform  over  i.  However,  these 
time  constants  would  not  necessarily  be  minimized.  From  Appendix  A,  Equations 
(A.2)  and  (A.3)  suggest  that  R^.j  =  R^  for  angles  close  to  zero  (A-0).  In  general, 
some  improvement  is  possible  since  Rv  is  at  least  partially  diagonalized.  However, 
this  statement  is  only  intuitive.  An  example  will  be  presented  in  Section  4.4.1 
where  the  use  cf  transforms  in  the  individual  fashion  actually  degrades  performance. 


4.2  TRLMS  Applied  to  the  Stacked  Vector 

Cra  way  to  eliminate  the  submatrix  diagcnalizaticn  of  the  previously  discussed 
method  is  to  attempt  to  diagonalize  the  entire  matrix  of  (4.7)  by  apeiving  a 
transform  of  length  IL  to  the  stacked  data  '/ectcr.  The  resulting  structure  is 
pictured  in  Fig  4.5.  This  propcsiticr  may  a:  first  be  unsettling.  Lhuika  the 
structure  oommeriv  seer.  ir.  filtem.nz  scci. rations,  elements  of  ihe  stacked  '/ectcr  X 
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are  no  longer  related  by  a  simple  unit  time  shift.  Upon  careful  examination  of  the 
derivation  of  the  TRL.VIS  algorithm,  no 'where  is  it  required  that  this  be  the  case. 


Each  weight  is  treated  individually,  and  the  delay  line  is  merely  a  convenient  way  of 
constructing  vectors.  The  bandpass  filter  bank  analogy  of  Section  2.2.3  is  no  longer 
as  clear,  but  nevertheless,  the  input  vector  can  still  be  whitened. 

A  requirement  for  the  TRLMS  algorithm  to  be  affective  in  this  case  is  that  be 
diagcnalizable.  For  three  or  more  sensors,  the  block  matrix  R^  departs  from  the 
familiar  Tceplitz  structure.  It  is,  however,  Hermetian  symmetric  (cr  symmetric  for 
the  real  case),  and  a  square  Hermetian  matrix  has  real  eigenvalues  and  a  unitary 
matrix  exists  which  will  diagonalize  it  [20].  The  effectiveness  of  the  transforms 
under  consideration  in  this  matter  is  yet  to  be  revealed.  Intuitively,  this  method 
should  outperform  the  individually  applied  transform,  due  to  the  fact  that  the  stacked 
vector  transform  attempts  to  diagonalize  the  system  autocorrelation  matrix  as  a 
whole. 


4.4  Other  Vector  Orderings 

The  concept  of  applying  the  transform  to  the  entire  stacked  vector  X  raises  this 
interesting  proposition:  dees  a  vector  erderirg  exist  that  will  make  the  use  of  a 
transform  mere  effective?  This  ■  would  be  a  very  difficult  statement  to  prove  due  to 
the  high  dependence  of  the  input  parameters  on  the  effectiveness  cf  a  transform  [U. 
what  is  ultimately  assured  is  a  gererai  result  valid  over  many  incut  s.grai  classes. 
\achsr  '."an  search  through  ail  ccss.b.e  vector  aiamant  orherungs  :o  find  ~o  oot.mai 


cirference. 

The  ordering  under  consideration  here  is  a  "columnwise"  ordering,  achieved  by 
thinking  of  the  weights  of  Fig  2.3  as  being  arranged  in  rows  and  columns.  The 
resuiting  generalized  data  vector  has  the  form 

1  r  ^  t 

X„  =  X10  *20‘  XfK-110  xn"°'xlJ  x2j ""  ‘  ”  '*<  K-2)  <  l-1>  x(K-IML-l)  J 

(4.1 1) 

For  the  three  sensor  case,  the  above  form  is  constructed  by  simply  interleaving  the 
elements  of  the  row  'vectors  Xt(n)  and  X2(n)  of  Eq.  (2.6b).  The  resulting  structure 
is  shown  in  Fig.  4.6  .  Thus,  the  stacked  vector  ordering  of  Fig.  4.5  can  also  be 
referred  to  as  a  "rowwise"  ordering. 

The  column-wise  ordering  effectively  shuffles  the  elements  of  R^  in  Eq.  (4.7). 
The  elements  of  for  a  row-wise  ordering  can  be  defined  as 
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The  sufcmatrix  is  generally  net  symmetric,  ar.a  negative  indices  are  needed. 
Appendix  A  shows  that  R  ,,  =  R  ?2?  hut  here  the  distinction  remains  to  clarify  the 
shuffling  of  the  terms,  which  results  in 
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(4.13) 


The  shuffling  is  in  accordance  with  the  arrangement  of  (4.11).  Similar  arrange¬ 
ments  arise  for  four  cr  mere  sensors. 

Seme  points  to  be  mace  about  (4.13)  are 

a)  If  R^.j  =  R^  as  Indicated  in  Appendix  A,  then  the  main  diagonal  and  every 


ether  diagonal  will  contain  identical  elements, 
b)  It  is  not  Tceciitz,  but  still  symmetric  and  disgcralizacle. 
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It  is  closer  to  a  Tcepiitz  structure  than 

(4.12)  since  more  than  half  of  the 
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The  remaining  diagonals  have  sitemating 

elements  c:  R  -2. 

diagonal,  (4.  io)  will  have  these  terms  closer  to  its  main  diagonal. 

It  is  known  that  the  OFT,  DHT,  and  the  OCT  will  not  diagonalize  a  Tceplitz  matrix 
but  rather  a  circular  matrix,  a  dyadic  matrix,  and  a  perturbed  Toeplitz  matrix, 
respectively  [17].  Nevertheless,  the  performance  gains  of  these  transforms  for 
Tceplitz  structures  have  been  'veil  established  (Chapter  3)  [1],  [2],  [11].  Thus,  the 
motivation  behind  shaping  the  matrix  into  a  Tcepiitz-like  structure  should  be 
quite  clear. 

For  the  CHT,  it  can  be  predicted  that  performance  for  the  row-wise  and  the 
column-wise  orderings  will  be  identical.  If  the  elements  of  the  DHT  matrix  are 
shuffled  in  the  same  manner  as  (4.13),  no  change  is  observed.  Tnis  is  true  for  four 
or  mere  sensors  as  well.  The  effects  of  the  ordering  of  (4.13)  on  the  OCT  and  OFT 
is,  however,  very  difficult  to  predict,  and  will  be  heuristically  examined  via 
computer  experiments  in  the  next  section. 


4.5  Computer  Experiments 

The  effects  of  the  three  vector  orderings  discussed  will  new  be  examined 
experimentally  for  the  three  sensor  GSC.  The  same  scenario  as  presented  in  Section 
4. 1  will  be  used.  The  examples  to  be  presented  reflect  the  general  behavior  for 
each  case,  and  were  selected  from  a  large  series  of  runs  using  many  random  number 
sequences.  4.1  curves  or.  a  single  plot  are  assumed  to  be  generated  from  the  same 
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S.=1G  ,  02=55°.  Note  that  again  the  effectiveness  depends  upon  the  angular  specing. 
The  two  jammers  coincident  at  10  are  effectively  equivalent  to  one  jammer  of 
power  -  23db  higher  than  the  desired  signal.  Thus,  improvement  for  one  incident 
jammer  is  along  the  lines  of  that  shown  in  Chapter  3.  For  closely  spaced  jammers 
as  in  Fig.  4.8,  improvement  is  somewhat  degraded  for  this  5°  spacing,  with 
effectiveness  also  dependent  upon  overall  angles  of  incidence.  Since  the  performance 
of  all  three  transforms  was  very  similar,  only  the  DCT  cur/e  is  shown  for  clarity. 
Significant  improvement  is  possible  not  only  for  A=K3  as  alluded  to  in  Sec .  4.2,  but 
fcr  At-A2  as  evidenced  in  the  upper  pair  of  curves  in  Fig.  4.8.  Perhaps  small 
relative  angles  cause  <J>12(cu)  cf  (A.3)  (and  in  turn  R  l2)  to  be  well-behaved,  resulting 
in  performance  similar  to  the  one  jammer  case. 


Contrary  to  intuition,  transforms  applied  to  the  row-wise  crderad  -vector  fcr  the 
three  sensor  C-SC  did  net  produce  a  significant  improvement  over  the  individual  casa. 
Figure  4.9  shews  a  very  slight  improvement  ever  the  individual  CCT  fcr  a  pair  cf 
closely  spaced  and  widely  spaced  jammers.  Again,  curves  for  the  other  transforms 
were  similar  and  were  omitted  for  ciaritv.  Parracs  for  this  t-vpe  cf  R  structure,  a 

v  >  y  r  v  7 

A 

fixed  transform  is  ineffective  in  its  disgcnaiizsticn.  Gains  are  s.iil  clearly  visible 
for  oicseiy  spaced  jammers,  however.  Fcr  one  jammer  (0.=92=  19w),  Fig  4.10 
reveals  3  difference  among  the  transforms.  Here  the  simple  CHT  was  rot  as 
effective  as  the  mere  powerful  CCT.  An  interesting  point  is  that  the  row-wise 

4.1C  shew  siizhtiv  dezrcc  sc  cerfcrmarcss  as  com  oared  to  the 
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Mucn  Tiers  premising  results  were  discovered  for  the  column-wise  ordering, 
specifically  for  that  utilizing  the  DCT.  Figure  4.11  shews  all  column  ordered 
transforms  for  the  slowiy  converging  S^IO0,  92=55°case.  The  column-DCT  shows  a 
"'"odb  improvement  over  the  identity  transform  after  5K  iterations.  For  this  three 
sensor  case,  this  was  the  effect  generally  observed  for  all  angle  spacings.  To  empha¬ 
size  the  substantial  improvements  possible,  Fig.  4.12  shows  the  same  curves  of 
Fig.  4.11  for  the  DCT  and  Identity  carried  out  for  6GK  iterations.  Note  the  unrea¬ 
sonably  slow  convergence  using  no  transform.  The  same  was  done  for  the  9t=-6Q° 
and  63=50°  case  of  Fig  4.2b,  along  with  the  corresponding  beampattem  shown  in 
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Performance  improvement  for  the  three  sensor  GSC  appeared  to  be  a  result 
specific  to  the  cclumn-CCT  as  typified  by  Fig.  4.14,  which  shows  little  dis- 
oemifcility  between  the  row  and  column  ordered  OFT.  Figure  4.15  again  reveais  the 
general  trend  that  ail  transforms  and  orderings  perform  reasonably  well  for  closely 
soacec  jammers,  as  here  the  oolumn-CCT  is  no  longer  outstanding. 

To  further  study  the  curious  effects  of  the  column- wise  OCT,  the  same  array 
structure  was  used  for  jammers  of  different  bandwidth  and  spectra.  See  Fig.  4.16. 
Jammer  1  was  colored  by  a  fourth  order  Hut  tar- worth  filter  of  normalized  center 
frequency  w<j=t/4  and  3db  bandwidth  cf  t/4.  Jammer  2  ised  a  second  order 
Lutterworth  filter  cf  cjj=3t/8  and  3dfc  bandwidth  of  rr/4.  The  filter  cf  Fig  3.2  was 
again  used  for  the  Icck-dirscticn  signal.  Cue  to  the  longer  wavelengths,  longer 
sucvectcr  lengths  'were  necessary,  sc  L=32,  resulting  in  a  transform  length  of  64. 
~c  provide  similar  misadjustment  levels  as  in  previous  examples,  the  stap  size  -was 
apprcximataiy  halved  tc  u=.3C2.  For  9, =-50“  arc  9-=55w,  the  output  SIR  is  shewn 
.r  F.g.  4.17  for  the  row  and  column  ordered  OCT.  The  improvement  is  clearly 
a /idem.  Trus  it  appears  that  for  at  least  this  three  sarscr  case  for  bandpass  incuts, 
the  us  a  of  a  transform  car.  be  advantageous,  as  the  column  ordered  OCT  performs 
consistently  -well  for  all  angles  of  incidence. 


<amcl.es  for  the  Five  Sensor  Casa 


.m..ar  exserimar.es  vara  bore  for  a  five  sensor  050.  The  mam  ourocse  uere 
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Euttarwcrth  filters.  For  Jammer  1,  4th  order,  cjo=tt/4,  3db  BW=t/4 
For  Jammer  2,  2nd  order,  o<r=37r/8,  3db  BW=t/4. 


signal  and  jammer  2  incident  at  d2= 56°  were  generated  by  the  filter  in  Fig.  3.2. 
Results  are  presented  in  Fig.  4.18  for  the  indicated  transforms  using  p=.GQ4.  and 
L=16,  giving  a  transform  length  of  64. 

The  five  sensor  array  is  capable  of  rejecting  4  jammers,  but  only  two  were  used 
in  Fig.  4.18,  leaving  two  extra  degrees  of  freedom.  Note  that  the  Identity  transform 
performed  much  better  with  five  sensors  than  with  three  as  pictured  in  say,  Fig. 
4.13.  This  is  due  to  the  extra  available  degrees  of  freedom  which  arise  at  the 
expense  of  using  extra  sensors  [19].  This  is  not  always  of  best  practical  interest, 
due  to  physical  size  or  cost  limitations.  Sensing  elements  for  the  GSC  may  involve 
expensive  analog  preprocessors  that  require  perfect  balance  for  the  blocking  pre¬ 
processor  of  Fig.  2.2.  to  'work  effectively. 
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The  use  cf  a  transform  is  still  somewhat  effective  according  to  Fig.  4.15, 
where  '*4dh  imprcvment  is  achieved.  Note  that  the  simple  DHT  is  slightly  mere 
effective  in  this  scenario  than  the  column-DCT,  again  exemplifying  the  high  data 
dependence  on  transform  efficiency.  The  individually  applied  DCT  exhibits  severely 
degraded  performance,  most  likely  due  to  the  subdiagcnalizaticn  of  R^.  Also,  the 
distinctive  improvements  shewn  by  the  column-DCT  Ln  the  previous  section  are  net 
seen  here. 

A  third  jammer  was  placed  at  S^-300  to  remove  one  cf  the  degrees  of  freedom. 
This  resulted  in  a  generally  slower  convergence  rate,  as  evident  from  the  25K 
samples  needed  in  Figs.  4.19.  Again,  up  to  ^4  db  improvement  was  achieved,  and 
no  noticeable  difference  is  seen  between  the  row  and  column  ordered  DCT  shown  in 
Figs.  4,i9a  and  4.19b,  respectively.  Unlike  Fig.  4.18,  the  DHT  of  Fig.  4.19c  did 
net  dc  as  -veil  here. 

In  general,  convergence  cf  these  five  sensor  cases  is  fairly  good  without  a 
transform,  sc  improvements  with  a  transform  are  rot  expected  to  be  great.  This  is 
possible  at  the  expense  of  extra  sensing  elements.  Clearly,  performance  is  also 
dependent  upon  the  number  cf  sensors,  and  generalizations  carrot  be  made  from  the 
three  sensor  case  alone. 
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CHAPTER  5 


CONCLUSIONS 


After  a  brief  review  of  the  Generalized  Sidelcbe  Canceller  and  the  Transform 

Domain  LMS  algorithm,  the  two  were  combined  successfully  to  improve  the 

convergence  rate  for  the  two  sensor  case.  The  performance  was  very  well-behaved 

for  all  three  transforms  under  consideration  (DFT,  DHT,  EXIT),  due  to  the  Toeplitz 

nature  of  the  autocorrelation  matrix  R  . 

x 

According  to  an  analogy  of  the  GSC  to  multiple  reference  noise  cancelling,  it 
was  shewn  that  the  results  of  extending  the  TRLMS  to  two  (or  mere)  references  are 
rot  as  definitive.  Many  arrangements  of  the  data  vector  X,  are  possible. 
Speculation  on  the  performance  cf  a  transform  for  three  vector  orderings  was  given: 
the  individual  case,  the  row- wise  ordering,  and  the  column- wise  ordering. 

The  three  sensor  case  was  the  main  example.  For  the  class  cf  wideband  inputs 
considered,  performance  of  individually  applied  transforms  fared  'well  for  closely 
spaced  jammers  only.  For  ether  angles,  poor  performance  'was  attributed  to  the 


sufcdiagcnalization  of  R  . 

In  an  attempt  to  diagonalize  the  entire  R^  matrix,  double  length  transforms  were 
used.  Cf  all  transforms  and  orderings  for  the  three  sensor  case,  the  column-wise 
DC"  appeared  to  be  uoiqueiy  effect;  -a.  It  perfcrrr.ad  consistently  well  ever  ail 
angles  and  many  different  bsrewidths.  Perhaps  the  DC"  can  iiagcraiize  the  t<ce  of 
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Interestingly,  Jayar.t  and  Nell  [17]  state  that  the  DCT  can  diagonalize  slightly 
perturbed  Tcepiitz  matrices.  The  CCT  is  well  known  to  provide  near  optimal 
performance  in  numerous  other  applications,  including  image  coding  and  channel 
equalization  [16],  [17],  so  its  distinction  here  should  not  come  as  a  surprise.  All 
other  combinations  showed  poor  performance,  except  for  the  cases  of  closely  spaced 
jammers,  where  most  all  combinations  gave  good  results. 

The  five  sensor  case  was  examined  briefly  for  two  and  three  jammers.  It  was 
observed  that  the  convergence  rate  decreased  as  jammers  were  added.  Possible  im¬ 
provements  were  not  as  drastic,  as  distinctions  between  row  and  column  orderings 
were  slight.  The  main  purpose  here  was  to  shew  that  the  results  for  the  columnwise 
CCT  are  not  general.  However,  seme  improvement  was  still  possible.  It  was  also 
revealed  here  that  individually  applied  transforms  can  actually  degrade  performance 
substantially  ever  the  transform-less  case,  again  an  effect  of  subdiagcnalizaticn. 

Overall,  it  was  found  that  improvement  of  convergence  rates  is  possible  using 
fixed  crthcgcrai  transforms,  but  performance  is  highly  dependent  upon  input  data  and 
the  array  processing  structure.  The  desired  resuit  of  being  able  to  have  ere 
transform  that  works  'well  for  ail  signals  and  numbers  of  sensors  seems  unlikely. 
In  an  adaptive  environment,  very  little  is  usually  known  about  incoming  signals. 
Therefore,  more  research  is  reeded  to  develop  criteria  for  choosing  a  transform 
cased  cn  simcie  known  parameters,  such  as  the  numcer  of  sensors,  the  ordering  of 
the  data  vectors,  or  perhaps  seme  figure  of  merit  which  can  be  calculated  from  a  few 
cats  samples. 

It  acoears  ohat  the  kev  lias  in  the  j-derstardirg  of  tre  arrav  arc  data  dscencert 
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structures  of  R^.  Many  researchers  have  used  the  Hilbert-Schmiat  (weak)  norm  [16] 
to  calculate  the  residual  correlation  of  a  transformed  matrix.  This  figure  of  merit 
measures  the  ability  of  a  transform  to  decorralate  its  inputs.  This  has  yet  to  be 
successfully  related  to  the  medal  time  constants  of  the  TRLMS  algorithm.  This  was 
attempted  in  the  course  of  this  research  but  not  presented,  since  no  meaningful  trends 
could  be  observed.  A  more  suitable  measure  may  be  necessary. 

Perhaps  ether  transforms  not  considered  here,  such  as  the  Haar  or  Discrete  Sine 
Transforms  [16]  may  be  more  effective.  Analysis  and  simulation  of  the  optimal 
KLT  should  be  performed.  This  may  reveal  any  trends  and  similarites  between  the 
optimal  basis  functions  and  those  of  a  fixed  transform  under  consideration.  Also, 
other  vector  orderings  may  exist  (pcssibly  optimal)  which  will  shape  R^  into  a 
structure  more  compatible  with  certain  transforms. 

Also  not  attempted  here  is  the  comparison  cf  TRLMS  to  the  performance  and 
computational  efficiency  cf  other  algorithms.  Perhaps  other  techniques  exist  which 
are  mere  predictable.  For  example,  a  similar  analysis  for  the  multichannel 
adaptive  lattice  as  applied  to  the  GSC  can  be  found  in  [7]. 

Also,  a  mere  careful  study  of  the  scenarios  presented  would  be  informative. 
Examining  effects  of  thermal  noise  and  other  array  imperfections  '-would  help  assess 
its  practicality.  Simulations  using  other  classes  cf  data  inputs  and  correlated 
inputs,  such  as  may  arise  from  multipath  interference,  should  be  done  to  test  the 
validity  cf  the  generalisations  made  from  the  experiments  presented  here. 
Interesting  results  mav  be  observed  if  'he  five  sensor  arrav  with  f cur  incident 
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two  and  three  sensor  simulations  did. 
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Finally,  the  extension  of  the  TRLMS  algorithm  to  multiple  inputs  may  also  be 
generalized  to  ether  applications.  The  various  ways  a  transform  can  be  applied  were 
brought  to  attention. 

In  conclusion,  the  analysis  and  experimental  results  presented  here  were 
intended  to  examine  the  possibility  of  using  fixed  orthogonal  transforms  in  an 
adaptive  beamforming  scenario.  Eehaviors  for  some  simple  inputs  were  categorized 
and  some  promising  results  were  obtained.  This  study  suggests  that  further  analysis 
and  evaluation  of  the  TRLMS  beamforming  algorithm  may  lead  to  more  useful  results 
in  the  future. 
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APPENDIX  A 


DERIVATION  OF  POWER  SPECTRA 
FOR  THE  THREE  SENSOR  GSC 


A  derivation  of  power  spectrum  and  the  cross-power  spectrum  of  the  reference 
inputs  may  be  useful  in  the  understanding  of  the  correlations  between  them.  Let 
$;(cj)  and  $2(o>)  be  the  spectral  densities  of  jammer  i  and  jammer  2  respectively, 
where  u  is  normalized  digital  frequency.  Without  loss  of  generality,  let  the  topmost 
sensor  of  Fig  4.1  be  used  as  a  reference  where  the  respective  delays  At  =  A2  =  0. 
The  transfer  function  for  the  i^1  jammer  to  the  k^1  reference  input  (through  the 
preprocessor)  is 


(z)  =2"(k't)Ai  -Z_kAi 


(A.  i) 


Tee  power  spectral  density  at  the  reference  is 

tiu)  =  +  inif(Q)  |®2(u)  !A-2al 

xkk 

=  2$t(a>)  (1  -  coscjAi)  +  2$2(cj)  (1  -  coscuAJ  .  (A.  2b) 


The  cross-power  spectrum  between  reference  channels  can  be  calculated  from 
$x:2^)=$x;i(<^)Hi2M>  *vhere  Hi2(oj)  is  the  transfer  function  between  the  first  arc 
second  reference  incuts.  In  the  Z  domain  H12(z)  =  z  Ai.  Tus  yields 


_ jo^A; 
— ^.e  J 


(1  -  ccsc^Ai)  -  2e  -u'^2  '1  -  ccs<->A 


v 


arc  aisc  $  [ui)  -  $  'coj  Note  that  wh er.  A  =  2  :r.  A  b; ,  i  ;u/  =  C  .o 
X2*  Xi2  1  xkk 

agreement  with  tha  blocking  behavior  of  the  preprocessor.  Also  the  terms  i n  A. 2b; 

are  related  to  the  these  in  (A.2fc)  by  a  complex  exponential,  corresccnding  to  the 

mtersenscr  delay  A.  The  autocorrelation  functions  car  be  obtained  erorr.  the  accve 

equations  by  taking  a  simple  inverse  2 TFT. 
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APPENDIX  3 


FORTRAN  COCE  LISTING  FOR 
TVE  THREE  SENSOR  GSC 
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